REporting quality of PilOt randomised controlled trials in surgery (REPORTS): a methodological survey protocol.

INTRODUCTION: The aim of this methodological review is to evaluate the completeness of reporting of surgical pilot and feasibility randomised trials as per the Consolidated Standards of Reporting Trials (CONSORT) extension to randomised pilot and feasibility trials. Moreover, we aim to assess for the presence of spin reporting and inconsistency between abstract and main text reporting in surgical pilot and feasibility randomised trials. METHODS AND ANALYSIS: A comprehensive, electronic search strategy will be used to identify studies indexed in Medline, Embase and Cochrane Central Register of Controlled Trials (CENTRAL) databases. Studies will be included if they are pilot or feasibility randomised trials of surgical interventions. The primary outcome will be overall CONSORT statement extension to randomised pilot and feasibility trials checklist completeness. This will be defined as trials reporting each of the 40 items in the CONSORT statement extension to randomised pilot and feasibility trials checklist. Secondary outcomes will include the reporting of individual studies as per the CONSORT extension to randomised pilot and feasibility trials, the use of spin reporting strategies, trial factors associated with reporting quality and spin strategy use, and consistency between abstract and main text reporting. Poisson and logistic regressions will be performed to explore the association between trial factors and completeness of reporting as measured by the number of reported CONSORT items. ETHICS AND DISSEMINATION: This is a methodological survey that has been registered a priori on the International Prospective Register for Systematic Reviews (PROSPERO) (CRD42023475512). Local ethics approval is not required. We plan to disseminate study results through peer-reviewed publication and conference presentations.

Reporting of Factorial Randomized Trials: Extension of the CONSORT 2010 Statement.

Importance: Transparent reporting of randomized trials is essential to facilitate critical appraisal and interpretation of results. Factorial trials, in which 2 or more interventions are assessed in the same set of participants, have unique methodological considerations. However, reporting of factorial trials is suboptimal. Objective: To develop a consensus-based extension to the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement for factorial trials. Design: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT extension for factorial trials was developed by (1) generating a list of reporting recommendations for factorial trials using a scoping review of methodological articles identified using a MEDLINE search (from inception to May 2019) and supplemented with relevant articles from the personal collections of the authors; (2) a 3-round Delphi survey between January and June 2022 to identify additional items and assess the importance of each item, completed by 104 panelists from 14 countries; and (3) a hybrid consensus meeting attended by 15 panelists to finalize the selection and wording of items for the checklist. Findings: This CONSORT extension for factorial trials modifies 16 of the 37 items in the CONSORT 2010 checklist and adds 1 new item. The rationale for the importance of each item is provided. Key recommendations are (1) the reason for using a factorial design should be reported, including whether an interaction is hypothesized, (2) the treatment groups that form the main comparisons should be clearly identified, and (3) for each main comparison, the estimated interaction effect and its precision should be reported. Conclusions and Relevance: This extension of the CONSORT 2010 Statement provides guidance on the reporting of factorial randomized trials and should facilitate greater understanding of and transparency in their reporting.

A System for Rapidly Yet Rigorously Evaluating the Quality of Randomized Controlled Trials.

ABSTRACT: This tutorial describes a system for rapidly yet rigorously assessing the quality of randomized controlled trials (RCTs). The system has 7 criteria, represented by the acronym "BIS FOES." The BIS FOES system directs readers to assess RCTs based on the following 7 criteria: the RCT's use (or not) of effective (1) Blinding; the RCT's use (or not) of (2) Intent-to-Treat Analysis; the RCT's (3) Size and other information reflecting the effectiveness of randomization; the amount of sample lost during (4) Follow-up; the (5) Outcomes examined by the RCT (specifically, the outcome measures used by the RCT), the (6) Effects reported (ie, the statistical and clinical significance of the RCT's primary, secondary, and safety findings), and any (7) Special Considerations (ie, additional strengths, limitations, or notable features of the RCT). The first 6 criteria are of basic importance to the assessment of every RCT, whereas the Special Considerations criteria allows the system to be expanded to include virtually any other important aspect of the RCT. This tutorial explains the importance of these criteria and how to assess them. This tutorial also describes how many BIS FOES criteria can be initially assessed from the RCT Abstract while also directing readers to specific locations in the RCT article where additional important information can be found. We hope that the BIS FOES system will help healthcare trainees, but also potentially clinicians, researchers, and the general public, rapidly and thoroughly assess RCTs.

Reporting quality of randomized controlled trials of angina pectoris with integrated traditional Chinese and western medicine interventions: a cross-sectional study.

BACKGROUND AND OBJECTIVE: Integrated traditional Chinese and western medicine (ITCWM), as a representative type of complex intervention, is commonly used for the treatment of angina pectoris (AP) in clinical practice. However, it is unclear whether the details of ITCWM interventions, such as rationale for selection and design, implementation and potential interactions for different therapies, were adequately reported. Therefore, this study aimed to describe the reporting characteristics and quality in randomized controlled trials (RCTs) of AP with ITCWM interventions. METHODS: Through a search of 7 electronic databases, we identified RCTs of AP with ITCWM interventions published in both English and Chinese from 1st Jan 2017 to 6th Aug 2022. The general characteristics of included studies were summarized, further, the quality of reporting was assessed based on three Checklists, including the CONSORT with 36 items (except for one item 1b about abstract), the CONSORT for abstracts (17 items), and a self-designed ITCWM-related checklist (21 items covering rationale and details of interventions, outcome assessment and analysis). The quality of RCTs published in English and Chinese, as well as journals and dissertations were also compared. RESULTS: A total of 451 eligible RCTs were included. For the reporting compliance, the mean score (95% Confidence Interval) of the CONSORT (72 scores in total), CONSORT for abstract (34 scores in total), and ITCWM-related (42 scores in total) checklists was 27.82 (27.44-28.19), 14.17 (13.98-14.37) and 21.06 (20.69-21.43), respectively. More than half items were evaluated as poor quality (reporting rate < 50%) among each Checklist. Moreover, the reporting quality of publications in English journals was higher than that in Chinese journals in terms of the CONSORT items. The reporting of published dissertations was better than that in journal publications regarding both the CONSORT and ITCWM-specific items. CONCLUSION: Although the CONSORT appears to have enhanced the reporting of RCTs in AP, the quality of ITCWM specifics is variable and in need of improvement. Reporting guideline of the ITCWM recommendations should be developed thus to improve their quality.

Is the evidence-based medicine movement counter-productive: are randomised controlled trials the best approach to establish evidence in complex healthcare situations?

In the modern era, evidence-based medicine (EBM) has been embraced as the best approach to practising medicine, providing clinicians with 'objective' evidence from clinical research. However, for presentations with complex pathophysiology or from complex social environments, sometimes there remains no evidence, and no amount of research will obtain it. Yet, health researchers continue to undertake randomised controlled trials (RCT) in complex environments, ignoring the risk that participants' health may be compromised throughout the trial process. This paper examines the role of research that seeks to obtain evidence to support EBM. We provide examples of RCTs on ear disease in Aboriginal populations as a case-in-point. Decades of ear research have failed to yield statistically significant findings, demonstrating that when multiple factors are at play, study designs struggle to balance the known disease process drivers, let alone unknown drivers. This paper asks the reader to consider if the pursuit of research is likely to produce evidence in complex situations; or if perhaps RCTs should not be undertaken in these situations. Instead, clinicians could apply empirical evidence, tailoring treatments to individuals while taking into account the complexities of their life circumstances.

Incomplete reporting of complex interventions: a call to action for journal editors to review their submission guidelines.

Reporting of intervention research has been inadequate for many years. The development and promotion of freely available checklists aims to address this problem by providing researchers with a list of items that require reporting to enable study interpretation and replication. In this commentary, we present evidence from a recent systematic review of 51 randomised controlled trials published 2015-2020 that inadequate intervention reporting remains a widespread issue and that checklists are not being used to describe all intervention components. In 2022, we assessed the submission guidelines of 33 journals that published articles included in our review and found that just one at the time encouraged the use of reporting checklists for all intervention components. To drive progress, we contacted the editors of the other 32 journals and requested that they update their submission guidelines in response. We conclude by highlighting the waste associated with current practices and encourage journals from all fields to urgently review their submission guidelines. Only through collective action can we build an evidence base that is fit for purpose.

[Evaluation of the report quality of Chinese and English randomized controlled trials of acupuncture based on CONSORT statement and STRICTA checklist].

OBJECTIVE: To evaluate the report quality of Chinese and English randomized controlled trials (RCTs) of acupuncture based on the CONSORT statement and STRICTA checklist. METHODS: The Chinese and English RCTs of acupuncture published from January 1, 2015 to December 31, 2019 were searched in 7 databases including PubMed. The report quality of the included RCTs was evaluated with the CONSORT 2010 statement and STRICTA checklist. RESULTS: A total of 506 Chinese RCTs and 76 English RCTs were included. According to the CONSORT statement, in Chinese RCTs, the items with report rate less than 50% accounted for 78.38% of all items, and the report rate of 25 items, such as background and reason, study design, outcome index, and sample size, was less than 10%. In English RCTs, the items with report rate less than 50% accounted for 35.14% of all items, and 5 items had a report rate of less than 10%. The difference of the report rate of 15 items, such as background, reason and study design, was more than 50% between Chinese and English RCTs. The report rate of all items of STRICTA checklist was relatively high in both Chinese and English RCTs. In Chinese RCTs, the items with report rate less than 50% accounted for 29.41% of all items, which included acupuncture rationale and depth of insertion. In English RCTs, only two items had a report rate less than 50%, which were acupuncture rationale, setting and context of treatment. The report rate of five items, including needle retention time, frequency and duration of treatment sessions, details of other interventions administered to the acupuncture group, setting and context of treatment, and precise description of the control or comparator in Chinese RCTs, were higher than in English RCTs. CONCLUSION: The report quality of Chinese acupuncture RCT needs to be improved urgently, and corresponding measures should be taken to further standardize the writing and reporting of acupuncture clinical research.

Evaluation of the report quality of Chinese and English randomized controlled trials of acupuncture based on CONSORT statement and STRICTA checklist / 中国针灸

OBJECTIVE@#To evaluate the report quality of Chinese and English randomized controlled trials (RCTs) of acupuncture based on the CONSORT statement and STRICTA checklist.@*METHODS@#The Chinese and English RCTs of acupuncture published from January 1, 2015 to December 31, 2019 were searched in 7 databases including PubMed. The report quality of the included RCTs was evaluated with the CONSORT 2010 statement and STRICTA checklist.@*RESULTS@#A total of 506 Chinese RCTs and 76 English RCTs were included. According to the CONSORT statement, in Chinese RCTs, the items with report rate less than 50% accounted for 78.38% of all items, and the report rate of 25 items, such as background and reason, study design, outcome index, and sample size, was less than 10%. In English RCTs, the items with report rate less than 50% accounted for 35.14% of all items, and 5 items had a report rate of less than 10%. The difference of the report rate of 15 items, such as background, reason and study design, was more than 50% between Chinese and English RCTs. The report rate of all items of STRICTA checklist was relatively high in both Chinese and English RCTs. In Chinese RCTs, the items with report rate less than 50% accounted for 29.41% of all items, which included acupuncture rationale and depth of insertion. In English RCTs, only two items had a report rate less than 50%, which were acupuncture rationale, setting and context of treatment. The report rate of five items, including needle retention time, frequency and duration of treatment sessions, details of other interventions administered to the acupuncture group, setting and context of treatment, and precise description of the control or comparator in Chinese RCTs, were higher than in English RCTs.@*CONCLUSION@#The report quality of Chinese acupuncture RCT needs to be improved urgently, and corresponding measures should be taken to further standardize the writing and reporting of acupuncture clinical research.

Effectiveness of a motivated, action-based intervention on improving physical activity level, exercise self-efficacy and cardiovascular risk factors of patients with coronary heart disease in Sri Lanka: A randomized controlled trial protocol.

BACKGROUND: Coronary heart disease (CHD), is the major contributor to cardiac-associated mortality worldwide. Lifestyle modification, including physical activity, is highly recommended for secondary prevention for patients with CHD. However, many people in Sri Lanka with CHD do not engage in adequate physical activity. OBJECTIVE: To develop a culture-specific, motivated, and action-based intervention and examine its effects on physical activity level, exercise self-efficacy, and cardiovascular risk factors among patients with CHD. METHODS AND MATERIALS: This is an assessor-blinded randomized controlled trial that will recruit 150 patients with CHD from the inpatients cardiac unit of a hospital in Batticaloa, Sri Lanka, and will randomly assign them either to the intervention group or the control group. The participants in the intervention group will receive a culture-specific and motivated, action-based intervention in addition to the usual care, while participants in the control will only receive the usual care. The intervention consists of a face-to-face preparatory session and 12-week motivated, action-based sessions which were developed based on the health action process approach (HAPA) framework. The face-to-face preparatory session will identify the health needs of the participants, develop a goal-oriented patient-centered action plan, and provide knowledge and an overview of the program. The 12-week motivated, action-based sessions consist of three monthly group education and center-based group exercises, followed by three 20-min individualized telephone follow-ups. Outcomes will be assessed immediately after the intervention and at one-month post-intervention. DISCUSSION: This protocol proposes a supervised centered-based group exercise with group education, and individualized telephone follow-ups guided by the HAPA framework to improve the physical activity level, exercise self-efficacy, and cardiovascular risk factors of patients with CHD. Results from this study will inform the effectiveness of a motivated, action-based intervention in a low-resource setting and provide information on the feasibility, barriers, and facilitators for lifestyle modification in Sri Lanka. TRIAL REGISTRATION: ClinicalTrial.gov.org PRS: NCT05051774; Date of registration: September 21, 2021.

Analysis of 567,758 randomized controlled trials published over 30 years reveals trends in phrases used to discuss results that do not reach statistical significance.

The power of language to modify the reader's perception of interpreting biomedical results cannot be underestimated. Misreporting and misinterpretation are pressing problems in randomized controlled trials (RCT) output. This may be partially related to the statistical significance paradigm used in clinical trials centered around a P value below 0.05 cutoff. Strict use of this P value may lead to strategies of clinical researchers to describe their clinical results with P values approaching but not reaching the threshold to be "almost significant." The question is how phrases expressing nonsignificant results have been reported in RCTs over the past 30 years. To this end, we conducted a quantitative analysis of English full texts containing 567,758 RCTs recorded in PubMed between 1990 and 2020 (81.5% of all published RCTs in PubMed). We determined the exact presence of 505 predefined phrases denoting results that approach but do not cross the line of formal statistical significance (P < 0.05). We modeled temporal trends in phrase data with Bayesian linear regression. Evidence for temporal change was obtained through Bayes factor (BF) analysis. In a randomly sampled subset, the associated P values were manually extracted. We identified 61,741 phrases in 49,134 RCTs indicating almost significant results (8.65%; 95% confidence interval (CI): 8.58% to 8.73%). The overall prevalence of these phrases remained stable over time, with the most prevalent phrases being "marginally significant" (in 7,735 RCTs), "all but significant" (7,015), "a nonsignificant trend" (3,442), "failed to reach statistical significance" (2,578), and "a strong trend" (1,700). The strongest evidence for an increased temporal prevalence was found for "a numerical trend," "a positive trend," "an increasing trend," and "nominally significant." In contrast, the phrases "all but significant," "approaches statistical significance," "did not quite reach statistical significance," "difference was apparent," "failed to reach statistical significance," and "not quite significant" decreased over time. In a random sampled subset of 29,000 phrases, the manually identified and corresponding 11,926 P values, 68,1% ranged between 0.05 and 0.15 (CI: 67. to 69.0; median 0.06). Our results show that RCT reports regularly contain specific phrases describing marginally nonsignificant results to report P values close to but above the dominant 0.05 cutoff. The fact that the prevalence of the phrases remained stable over time indicates that this practice of broadly interpreting P values close to a predefined threshold remains prevalent. To enhance responsible and transparent interpretation of RCT results, researchers, clinicians, reviewers, and editors may reduce the focus on formal statistical significance thresholds and stimulate reporting of P values with corresponding effect sizes and CIs and focus on the clinical relevance of the statistical difference found in RCTs.

Sample size calculations in high-profile surgical trials that use patient-reported outcome measures: systematic review.

Sample size calculations from high-profile surgical RCTs that used a patient-reported outcome measure as primary outcome were reviewed systematically against Difference ELicitation in TriAls (DELTA2) standards, with a focus on target differences. In this sample of trials, there was frequent use of suboptimal methods to determine the target difference, and sample size calculations were generally not reported to DELTA2 standards. This risks over-recruitment and/or erroneous trial conclusions, which clinicians should be aware of when interpreting published trials.

PROSPECT guidelines for video-assisted thoracoscopic surgery: a systematic review and procedure-specific postoperative pain management recommendations.

Video-assisted thoracoscopic surgery has become increasingly popular due to faster recovery times and reduced postoperative pain compared with thoracotomy. However, analgesic regimens for video-assisted thoracoscopic surgery vary significantly. The goal of this systematic review was to evaluate the available literature and develop recommendations for optimal pain management after video-assisted thoracoscopic surgery. A systematic review was undertaken using procedure-specific postoperative pain management (PROSPECT) methodology. Randomised controlled trials published in the English language, between January 2010 and January 2021 assessing the effect of analgesic, anaesthetic or surgical interventions were identified. We retrieved 1070 studies of which 69 randomised controlled trials and two reviews met inclusion criteria. We recommend the administration of basic analgesia including paracetamol and non-steroidal anti-inflammatory drugs or cyclo-oxygenase-2-specific inhibitors pre-operatively or intra-operatively and continued postoperatively. Intra-operative intravenous dexmedetomidine infusion may be used, specifically when basic analgesia and regional analgesic techniques could not be given. In addition, a paravertebral block or erector spinae plane block is recommended as a first-choice option. A serratus anterior plane block could also be administered as a second-choice option. Opioids should be reserved as rescue analgesics in the postoperative period.

Videolaryngoscopy vs. direct Macintosh laryngoscopy in tracheal intubation in adults: a ranking systematic review and network meta-analysis.

Videolaryngoscopes are thought to improve glottic view and facilitate tracheal intubation compared with the Macintosh direct laryngoscope. However, we currently do not know which one would be the best choice in most patients undergoing anaesthesia. We designed this systematic review with network meta-analyses to rank the different videolaryngoscopes and the Macintosh direct laryngoscope. We conducted searches in PubMed and a further five databases on 11 January 2021. We included randomised clinical trials with patients aged ≥16 years, comparing different videolaryngoscopes, or videolaryngoscopes with the Macintosh direct laryngoscope for the outcomes: failed intubation; failed first intubation attempt; failed intubation within two attempts; difficult intubation; percentage of glottic opening seen; difficult laryngoscopy; and time needed for intubation. We assessed the quality of evidence according to GRADE recommendations and included 179 studies in the meta-analyses. The C-MAC and C-MAC D-Blade were top ranked for avoiding failed intubation, but we did not find statistically significant differences between any two distinct videolaryngoscopes for this outcome. Further, the C-MAC D-Blade performed significantly better than the C-MAC Macintosh blade for difficult laryngoscopy. We found statistically significant differences between the laryngoscopes for time to intubation, but these differences were not considered clinically relevant. The evidence was judged as of low or very low quality overall. In conclusion, different videolaryngoscopes have differential intubation performance and some may be currently preferred among the available devices. Furthermore, videolaryngoscopes and the Macintosh direct laryngoscope may be considered clinically equivalent for the time taken for tracheal intubation. However, despite the rankings from our analyses, the current available evidence is not sufficient to ensure significant superiority of one device or a small set of them over the others for our intubation-related outcomes.

Melanoma trials that defined surgical management: Overview of trials that established NCCN margin guidelines.

Since the observation that clearance of all visible and microscopic tumors from cutaneous melanoma is critical to prevent a recurrence, wide surgical margins have been central to surgical dogma. In the last several decades, more conservative margin widths have been vigorously studied by surgical investigators to lessen wound complications, the need for reconstruction, and healthcare costs. This review summarizes surgeon-led clinical trials that define current guidelines and highlights the challenges to initiate and perform trials today.